Is Turbulence as Simple as Tossing a Coin? 
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A large variety of problems in statistical physics use a Gaussian distribution as a starting point. 
For the problem of intermittency in fluid turbulence, the Gaussian approximation is not a useful 
beginning. We find that the Cramer's rate function in the theory of large deviations as used in a 
simple coin toss is a promising starting point for giving an account of intermittency. In addition, it 
offers another view of Jarzynski equality. 
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Large deviations play a significant role in many 
branches of non-equilibrium statistical physics [J, 
They are difficult to handle because their effects though 
small, are not amenable to perturbation theory. All the 
conventional perturbation theories in statistical physics 
are fashioned about a Gaussian distribution, which al- 
most by definition, is the distribution with no large devia- 
tions. This can be seen in static critical phenomena, criti- 
cal dynamics, dynamics of interfacial growth, statistics of 
polymer chain and myriad other problems[3(. However, 
the Gaussian model fails to be a starting point while dis- 
cussing intermittency in fluid turbulence H [{J d, 0, S, H, 
03 Elf El El El El EH- In the large deviation theory, 
the central role is played by the distribution associated 
with tossing of a coin. Our contention is: the simple 
coin toss is the "Gaussian model" of problems where rare 
events play significant role. We illustrate this by apply- 
ing it to the studies of intermittency in fully developed 
turbulence and Jarzynski equality. 

The high Reynolds number turbulence remains the 
prime age old problem dominated by rare events, which 
still eludes a satisfactory theoretical understanding. Be- 
fore we plunge into the problem of modeling intermit- 
tency in a turbulent fluid, let us begin by briefly review- 
ing the large deviation theory in the context of a coin toss 
experiment [13 • Suppose we have a biased coin, such that 
for each toss the probability of obtaining "head" is l p'. If 
we assign the value 1 to the outcome "head" (each out- 
come is denoted by Xi where i = 1,2,...) and to the 
outcome "tail" , then the mean after N trials is 



1 N 

i=l 



(1) 



As N — > oo, it is expected that Mn — > p. The question 
is: For large N, what is the probability that Mm differs 
from p by at least x (where x is any pre-assigned frac- 
tion less than unity) ? The meaning of large deviation is 
that however large N may be this probability is nonzero 



and if the Xi's are bounded, independent and identically 
distributed random variables, then Crammers theorem 
asserts that the tail of the probability distribution of Xi 
is given by 



P{M N >x)& e~ NI ^ for x > p 
P(M N <x)& e~ NI ^ for x < p 



(2) 



To apply this result in different disciplines of statistical 
physics, we require P{Mn ~ x) and it is Varadhan's 
theorem that ensures that the sequence Mjv itself satisfies 
a large deviation principle i.e. P(Mn ss x) ~ e~ NItyX \ 
For the coin toss under consideration, Chernoff 's formula 
gives the rate function I(x) as follows: 



I(x) = x In - — h (1 — x) In 

p 1-p 



(3) 
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and this is the central result that we will use. 

Turning to turbulence, in 1941 Kolmogorov [l8j in- 
voked the concept of Richardson's cascade [19| of eddies 
to propose a phenomenological model (K41) for three 
dimensional incompressible turbulence at high Reynolds 
number. Even today this is the cornerstone of our 
understanding of turbulence. Understanding turbulence 
is understanding the small scale behaviour of the velocity 
structure function S q (l), where S q (l) = (\Av.(f/\l\)\ g ), 
with Av = v(f + I) — v(r) and T is a distance which 
is short compared to macroscopic length scales like the 
system size but is large compared to molecular scale 
where viscous dissipation takes place. The angular 
bracket denotes ensemble average (i.e. average over 
different values of 'f ). The observation is that S q (l) 
has a scaling behaviour where I is in the range 
indicated (so called inertial range). Finding ( q can be 
described as the holy grail of turbulence. K41 gives 
C q = 9/3 — a result which is exact for q = 3 and very 
close to experimental findings for low value of q. There 
is systematic departure from q/3 at relatively higher 
values of q. This is the phenomenon of intermittency. Of 
particular interest is the case q = 6. Since |Aw| 3 /^ is a 
measure of the local energy transfer rate (same as energy 
input and energy dissipation rate in K41 and thus a 
constant), we expect £g = 2. The deviation 2 — is thus 
a very sensitive quantity and is often singled out for 
special treatment. The exponent fi = 2 — £g is formally 



2 



called the intermittency exponent and the experimental 
measurements agree on a value 0.2 for \i. It can be 
viewed as the co-dimension of dissipative structures. 

The model of intermittency are usually constructed 
on a phcnomcnological basis by thinking of various ways 
of modifying the Richardson's cascade picture. The 
/3-model, the bifractal model and the multifractal model 
all belong to this class. The crucial hypothesis is that 
the daughter eddies produced from the mother eddies 
are not space filling and the active part of space is in 
general a multifractal. The velocity field has different 
scaling exponents on different fractal sets that form 
the multifractal structure. These scaling exponents 
can, in principle, yield C, q . This multifractality can also 
be defined and measured in terms of the fluctuations 
of the local dissipation rate rather than in terms of 
the fluctuations of the velocity increments Av. The 
key element, that is needed to define multifractality in 
terms of dissipation is the local space average of energy 
dissipation over a ball of radius I centered around a point 
at r: s^r) = Jjfr f^^^ d 3 ? T,i,j[9jVi(f') + diVj(P)} 2 . 
If the dissipation is multifractal, moments of ei follow 
a power law behaviour at small I, i.e. (ef) ~ l Tq . 
Kolmogorov's refined similarity hypothesis relates the 
statistical properties of fluctuation of velocity increment 
to those of the space averaged dissipation and yields: 
Cq = | + Tq/3 . We now carry out the usual speculation 
that since the higher order velocity structure factors 
differ most strongly from K41, then the probability 
distribution for the velocity increments must differ most 
strongly from that appropriate to K41 in the tail of the 
distribution. The tail of a distribution involves rare 
events and this is how the theory of large deviations 
enters the picture. Following Landau's observation on 
K4l[2(|, Kolmogorovjij and ObukhovQ introduced 
fluctuations in the dissipation rate. Careful experi- 
ments revealed the existence of these fluctuations. The 
fluctuations, however, occur rarely and these are the 
rare events of turbulence. This allows us to establish a 
quantitative bridge between turbulence and theory of 
large deviations. 

More than a decade ago, Stolovitzky and 
Sreenivasan[l5j], in somewhat different approach 
tried to validate refined similarity hypothesis by viewing 
turbulence as a general stochastic process (fractional 
Brownian motion to be precise). While this was a very 
significant achievement, there was a shortcoming in 
that the theory ruled out the existence of correlation 
functions like S3. It indeed is surprising since the 
readers may know that the only exact non-trivial result 
existing in the theory of turbulence is Kolmogorov law: 
£3(0 — However as we shall note, their approach 

allows us to make direct contact with the terms of large 
deviation that signify the occurrence of rare events. It 
can be observed that si plays the role of Mn of equation 
([T]) and it is the deviation from the expected mean e that 
we are interested in. As I — > 00, this deviation variable 
has a distribution according to the role of equation J2]). 



We hope a simplification: The £1 — e can range from 
large negative to large positive values. We bring the 
range between to 1 by defining a variable as: 



Z T {£i) 



1 + tanh 



(4) 



where S is a constant with dimension of e. We now make 
the drastic assumption that since s\ — e is a rare event, 
the distribution of Zt can be considered similar to that 
for the coin-toss with a biased coin and accordingly, we 
can hypothesize that 



P(Z T ) oc e -"W 



(5) 



Here, N is number of random variables. This simple 
model yields value of fi w 0.16 which is quite close to 
the presently accepted value. Also, a ( g vs <; plot has 
been obtained that is not only convex but also follows 
She-Leveque scaling [16J faithfully enough for a model as 
simple as this. Please refer to figure-1. In what follows 
we describe how these results are arrived at. 

The one dimensional velocity derivative can be use to 
express the global ave rag e of the full energy dissipation 
if local isotropy exists [2l|, [22j]. The velocity increment is 
given by 



Av(l) 



r+l 



dv 
dr 



dr 



and ergo, the energy dissipation rate is 





(6) 



(7) 



If we define D, = ^ | 



(^) 1/3 
1/3 



and N = -J- 



(where, 77 

is Kolmogorov scale, (77s) 1/J is Kolmogorov velocity scale 
and K is the number of Kolmogorov scales over which one 
obtains smoothness), then equation J7]) may be rewritten, 
upon discretization, as: 



1 N 

i=l 



(8) 



Here, Yj, = — e. In the letter, we have assumed the 
relation ([8} to be the parallel of equation ([I]) . Owing to 
the contraction principle, the rate function for si — e and 
Z{e{) are same. Thus, using equations (JH) and ((SJ), 
we can write: 



/oh(-)f{(r(^)^p. 



/o{(r(f5f) : 



N 



dx 



We assume that to the leading order (|ej — e\ q ) ~ P 



(9) 
By 



trial and error, we fix the inertial range as N = 30 to 60 
and calculate numerically /_t(= — T2) = 0.16. Similarly, 



3 



3 




2 4 6 8 



q 

FIG. 1: ( q vs. q curve in fully developed fluid turbu- 
lence. The dashed line joining the asterisk is the celebrated 
She-Leveque scaling law. The circles joined by the solid line 
denote the values of £ p (for corresponding q) as obtained by 
dint of the model proposed herein. For every q, first (|e; — e\ q ) 
vs. N is plotted in log-log scale using the data yielded during 
the numerical integration of equation © and then the obser- 
vation that for TV = 30 to 60, we get a fairly straight line 
leads us to attempt fitting the range linearly. The process 
gives a value for r q . The relation £ 9 = q/3 + r q , then, tells us 
what is the corresponding value for C, q . One can see, the fit 
is remarkable. There is room for improvement in extending 
the inertial range and in getting better fit for higher C, q s. As 
mentioned in this letter, the form of Zt is crucial. 

we calculate ( q (= q/3 + T q / 3 ) for various q. Note that to 
obtain the numerical solution for the integrals in equation 
, we have dropped the diverging terms from the finite 
series that represent the integrands as they are suitably 
discretized for their evaluation by Simpson's one-third 
rule. 

Our model's inherent bias for the value 0.26 for the 
parameter p in order to closely mimic the realistic turbu- 
lent fluid's scaling properties would seem so natural when 
it is compared with a particular successful multifractal 
cascade model[23j based on a generalized two-scale Can- 
tor set. In that model, as the eddies breakdown into 
two new ones, the flux of kinetic energy into the smaller 
scales is hypothesized to be dividing into non-equal frac- 
tions p = 0.3 (quite close to our value of p = 0.26!) and 
1 — p = 0.7. It could fit remarkably well the entire spec- 
trum of generalized dimensions [24[ and (equivalently) the 
singularity spectrum (the so-called f — a curve (25|) for 
the energy dissipation field in many a turbulent flow. 

We finally note that the large deviation result that we 
have used lends insight into yet another frontier of non- 
equilibrium statistical mechanics — that of the various 
fluctuation theorems [H, [27|, IHIH, HI- We will focus on 
one of them: Jarzynski equality. Here one begins with 
a system in equilibrium and then switches on a time de- 
pendent force for a period of r. We consider the different 
microstates corresponding to an initial equilibrium state 



and consider the time evolution of each initial condition. 
The work done w over the time r is calculated along each 
path and then average e~ w over the ensemble of all possi- 
ble initial conditions. This average is denoted by (e~ w ). 
This gets related to the exponential of the free energy 
difference AF between initial and final states leading to 
Jarzynski's equality. Defining Wd = w—AF, the equality 
can also be cast in the form: 

(e~ WD ) = 1 (10) 

where wd is the dissipative work along a 'given' path and 
the fact that average is unity implies that there are paths 
for which wd < — a case of transient violation of the 
second law of thermodynamics. These violations can be 
portrayed as the rare events, which are highlighted by 
Jarzynski equality. 

To verify Jarzynski equality i.e., in equation (|10p. 
we consider a system under the application of an ex- 
plicitly time dependent force that causes the system to 
evolve from an initial equilibrium state to a final state. 
If we repeat the same process M times keeping initial 
and final microstate fixed, then owing to the inherent 
stochasticity of the system, every time we get a different 
dissipative work uP D along a single phase space trajec- 
tory (jth trajectory) of the 'ensemble of M trajectories'. 
Let's define a sample mean over the M trajectories as 
Wd = jj J2jLi w d- Now, Wd can always be expressed 

as WD + jtf y~]^r-i $ where <P is the fluctuation around the 
dissipative work along jth trajectory. As M is large, the 
summation over all fluctuations will be negligibly small 
in comparison to the other term. Therefore, by showing 
(e~ WD ) = 1, we can basically conclude that (e~ WD ) = 1; 
hence, Jarzynski equality stands verified. Please refer 
figure-2. So, how exactly we prove it? 

Well, coming on the technique employed to verify 
Jarzynski equality, first of all we observe that Wd is a 
random variable measured over the ensemble of all mi- 
croscopic states. We define a variable Zj(Wd) as, 



Zj{W D ) = -[l-twh{W D + c)] (11) 

with an arbitrary c > 0. We define: p = i(l — tanhc) and 
assume that Zj(Wd) corresponds to a coin toss experi- 
ment with a biased coin, where the probability of getting 
tails is p. We notice that the probability of Wd being 
negative is the same as Zj having value between p and 
1 while Wd being positive covers the range to p. The 
probability of finding a value of Zj between and 1 is 
then given by equation ([2]) with the rate function given 
by the equation ©. The biased coin ensures that the 
negative values of Wd — which basically are the rare 
events — are suppressed, as it should be. We note from 

the definition of Zj that e~ Wo = e c J i Zj Z] and hence 
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FIG. 2: Verification of Jarzynski equality. The solid, 
dotted, dashed and dot-dashed lines are respectively for p — 
0.15, 0.25, 0.35 and 0.45. The curves in the figure are obtained 
by numerically integrating equation (|12p . 



For different values of p < 1/2, we numerically evaluate 
the above integral for N number of realizations to reach 
the conclusions discussed earlier in the letter. 

In the closing, one would appreciate the simplicity 
of biased coin-toss experiments and its reasonably 
astonishing success in predicting /i renders the need for 
more complicated models redundant. We believe just 
by being able to find a more appropriate function Zt, 
we can make big leaps in the rather complex theory of 
turbulence. Moreover, by showcasing that Jarzynski 
equality can be verified within the similar framework, 
we inject confidence into our contention that the simple 
coin toss is the "Gaussian model" of problems where 
rare events play significant role. 
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its ensemble average is, 



N(l-x) 



dx 



(e- w °) 



JO \x 



Nx 



1-P 

1-x 



N(l-x) 



(12) 



dx 
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